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Abstract. We consider algorithms for preprocessing labelled lists and trees so that, for any two nodes 
u and V we can answer queries of the form: What is the mode or median label in the sequence of labels 
on the path from uto v. 



1 Introduction 



Let A — ai, . . . ,an he a list of elements of some data type. Many researchers have considered the 
problem of preprocessing A to answer range queries. These queries take two indices 1 < i < j < n and 
require computing F{ai, . . . aj) where F is some function of interest. 

When the elements of A are numbers and F computes the sum of its inputs, this problem is 
easily solved using linear space and constant query time. We create an array B where bi is the sum of 
the first i elements oi A. To answer queries, we simply observe that + • • • + % = bj — fe^-i. Indeed this 
approach works even if we replace + with any group operator for which each element x has an easily 
computable inverse —x. 

A somewhat more difficult case is when + is only a semigroup operator, so that there is no 
analagous notion of — . In this case, Yao L16J shows how to preprocess a list A using 0{nk) space so that 
queries can be answered in 0{ak{n)) time, for any integer fc > 1. Here ak is a slow growing function 
at the fcth level of the primitive recursive hierarchy. To achieve this result the authors show how to 
construct a graph G with vertex set F = {!,...,«} such that, for any pair of indices l<i<j<n, G 
contains a path from i to j of length at most ak {n) that visits nodes in increasing order By labelling each 
edge {u, v) of G with the sum of the elements queries are answered by simply summing the 

edge labels along a path. This result is optimal when F is defined by a general semigroup operator 1 17J . 

A special case of a semigroup operator is the min (or max) operator In this case, the function 
F is the function that takes the minimum (respectively maximum) of its inputs. By making use of the 
special properties of the min and max functions several researchers U 13 have given data structures of 
size 0{n) that can answer range minimum queries in 0(1) time. The most recent, and simplest, of these 
is due to Bender and Farach-Colton yj . 

Range queries also have a natural generalization to trees, where they are sometimes call path 
queries. In this setting, the input is a tree T with labels on its nodes and a query consists of two nodes 
u and V. To answer a query, a data structure must compute F{li, . . . ,lk), where li, . . . ,lk is the set of 
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Table 1 : Summary of results in this paper. 



labels encountered on the path from u to u in T. For group operators, these queries are easily answered 
by an 0{n) space data structure in 0(1) time using data structures for lowest-common-ancestor queries. 
For semi-group operators, these queries can be answered using the same resource bounds as for lists 

G1[T3. 

In this paper we consider two new types of range queries that, to the best of our knowledge, 
have never been studied before. In particular, we consider range queries where F is the function that 
computes a mode or median of its input. A mode of a multiset S is an element of S that occurs at least 
as often as any other element of S. A median of S is the element that is greater than or equal to exactly 
[|S'|/2J elements of S. Our results for range mode and range median queries are summarized in Tabled 
Note that neither of these queries is easily expressed as a group, semi-group, or min/max query so they 
require completely new data structures. 

The remainder of this paper is organized as follows: In Section|2lwe consider range mode 
queries on lists. In Section|3lwe discuss range mode queries on trees. In Section^we study range 
median queries on lists. In Section]^ we present data structures for range median queries on trees. 
Finally, in Section|S]we summarize and conclude with open problems. 

None of the four lemmas used in this paper are surprising, but some of their proofs are rather 
involved. Therefore this extended abstract omits the proofs of all lemmas. 
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2 Range Mode Queries on Lists 



In this section, we consider range mode queries on an list A — ai, . . . , a„. More precisely, our task is 
to preprocess A so that, for any indices i and j,l<i<j<n, we can return an element of a,, ... , aj 
that occurs at least as frequently as any other element. Our approach is to first preprocess A for range 
counting queries so that, for any i, j and x we can compute the number of occurences of 2: in , . . . , aj . 
Once we have done this, we will show how a range mode query can be answered using a relatively small 
number of these range counting queries. 

To answer range counting queries on A we use a collection of sorted arrays, one for each unique 
element of A. The array for element x, denoted Ax contains all the indices 1 < i < n such that ai — x, 
in sorted order Now, simply observe that if we search for i and j in the array Ax, we find two indices k 
and I, respectively, such that, the number of occurences oi x in ai, aj is I — k. Thus, we can answer 
range counting queries for x in 0(log?i) time. Furthermore, since each position in A contributes exactly 
one element to one of these arrays, the total size of these arrays is 0{n), and they can all be computed 
easily in O(nlogn) time. 

The remainder of our solution is based on the following simple lemma about modes in the union 
of three sets. 

Lemma 1. Let A, B and C be any multisets. Then, if a mode of Au B U C is not in A or C then it is a 
mode of B. 

In the next two subsections we show how to use this observation to obtain efficient data struc- 
tures for range mode queries. In the first section we show how it can be used to obtain an efficient 
time-space tradeoff In the subsequent section we show how to it can be used to obtain an data structure 
with 0(1) query time that uses subquadratic space. 



2.1 A Time-Space Tradeoff 

To obtain a time-space tradeoff, we partition the list A into b blocks, each of size n/b. We denote the ith 
block by Bj. For each pair of blocks Bi and Bj, we compute the mode to^ j of -B,;+i U • • • U -Bj-i and store 
this value in a lookup table of size 0(6^). At the same time, we convert A into an array so that we can 
access any element in constant time given its index. This gives us a data structure of size 0(n + 6^). 

To answer a range mode query (i, j) there are two cases to consider In the first case, j — i < n/b, 
in which case we can easily compute the mode of at, aj in 0{{n/b) log n) time by, for example, sorting 
ai, . . . ,aj and looking for the longest run of consecutive equal elements. 

The second case occurs when j — i > n/b, in which case and aj are in two different blocks 
(see Fig.0. Let Bii be the block containing i and let Bji be the block containing j. Lemma^tells us 
that the answer to this query is either an element of Bi', an element of Bj>, or is the mode nii'^ji of 
Bj'+i U • • • U Thus, we have a set of at most 2n/b + 1 candidates for the mode. Using the range 

counting arrays we can determine which of these candidates is a mode by performing 2n/b+ 1 queries 
each taking O(logn) time, for a query time 0{{n/b) logn). By setting b = n^~'^, we obtain the following 
theorem: 
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Figure 1: The mode of either an element of Bi', an element of Bj, or is the mode m^/ j/ of 

Bi'+i, . . . , -Bj'+i- 



Theorem 1. For any < e < 1/2, there exists a data structure of size 0{n^ that answers range mode 
queries on lists in time 0{n'^ logrt).^ 



2.2 A Constant Query-Time Subquadratic Space Solution 



At one extreme, Theorem^gives an 0{n) space, 0(\/nlogn) query time data structure for range mode 
queries. Unfortunately, at the other extreme it gives an O(n^) space, 0(log n) query time data structure. 
This is clearly non-optimal since with 0{'n?) space we could simply precompute the answer to each of 
the (2) possible queries and then answer queries in constant time. In this section we show that it is 
possible to do even better than this by giving a data structure of subquadratic size that answers queries 
in constant time. 

Let k — njh and consider any pair of blocks Bi' and By. There are fc^ possible range mode 
queries such that i is in Bi' and j is in By. Each such query returns a result which is either 
an element of Bi' , an element of By or the mode of U • • • U By^\. Therefore, we could store the 
answers to all such queries in a table of size fc^, where each table entry is an integer in the range 0, . . . , 2fc 
that represents one of these 2fc + 1 possible outcomes. The total number of such tables is (2fc + 1)*^' and 
each table has size O(fc^), so the total cost to store all such tables is only 0{k^{2k + 1)'^ ). Therefore, if 
we choose k = ^logn/log log n, the total cost to store all these tables is only 0{n^ log log n/ log n). 

After computing all these tables, for each pair of blocks Bi' and Bji we need only store a pointer 
to the correct table and the value of the mode rmij' of B^'+i U • • • U Bj'-i. Then, for any range mode 
query with endpoints in Bf and Bji we need only perform a table lookup and use the integer result 
to report the mode either as an element of Bi' an element of Bj' or nii' j' . The total size of this data 
structure is 0(&^ + n) = 0{{n/k)'^ + n) = 0{n? log log n/ log n). 

To handle range mode queries (i, j) where i and j belong to the same block, we simply precom- 
pute all solutions to all possible queries where i and j are in the same block. The total space required 
for this is 0{bk^) = 0{n log^ n) which is much smaller than the space already used. 

Theorem 2. There exists a data structure of size 0(n^ log log n/ log n) that can answer range mode queries 
on lists in 0{1) time. 

^The query time of TheoremlTlcan be improved by observing that our range counting data structure operates on the universe 
1 , . . . , n so that using comphcated integer searching data structures |'13J 1121 1141 , the logarithmic term in the query time can 
be reduced to a doubly-logarithmic term. We observed this but chose not to pursue it because the theoretical improvement is 
negligible compared to the polynomial factor already in the query time. The same remarks apply to the data structure of Sectionlsl 
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Figure 2: The number of nodes labelled x on the path from m to w is x{u) + x{v) — 2x(parent(ii;)). 
3 Range Mode Queries on Trees 



In this section we consider the problem of range mode queries on trees. The outline of the data structure 
is essentially the same as our data structure for lists, but there are some technical difficulties which come 
from the fact that the underlying graph is a tree. 

We begin by observing that we may assume the underlying tree T is a rooted binary tree. To see 
this, first observe that we can make T rooted by choosing any root. We make T binary by expanding any 
node with d > 2 children into a complete binary tree with d leaves. The root of this little tree will have 
the original label of the node we expanded and all other nodes that we create are assigned unique labels 
so that they are never the answer to a range mode query (unless no element in the range occurs more 
than once, in which case we can correctly return the first element of the range). This transformation 
does not increase the size of T by more than a small constant factor. 

To mimic our data structure for lists we require two ingredients: (1) we should be able to answer 
range counting queries of the form: Given a label x and two nodes u and v, how many times does the 
label X occur on the path from u to v? and (2) we must be able to partition our tree into 0{b) subtrees 
each of size approximately n/b. 

We begin with the second ingredient, since it is the easier of the two. To partition T into subtrees 
we make use of the well-known fact (see, e.g.. Reference |3|) that every binary tree has an edge whose 
removal partitions the tree into two subtrees neither of which is more than 2/3 the size of the original 
tree. By repeatedly applying is fact, we obtain a set of edges whose removal partitions our tree into 0{b) 
subtrees none of which has size more than n/b. For each pair of these subtrees, we compute the mode 
of the labels on the path from one subtree to the other and store all these modes in a table of size 0{b'^). 
Also, we give a new data field to each node w of T so that in constant time we can determine the index 
of the subtree to which v belongs. 

Next we need a concise data structure for answering range counting queries. Define the lowest- 
common-ancestor (LCA) of two nodes u and w in T to be the node on the path from u to u that is closest 
to the root of T. Let x{v) denote the number of nodes labelled x on the path from the root of to v, or 
if w is nil. Suppose w is the LCA of u and v. Then it is easy to verify that the number of nodes labelled x 
on the path from m to w in T is exactly x{u) + x{v) — 2a;(parent(ti;)), where parent(u') denotes the parent 
of w in T or nil if w is the root of T (see Fig.lJJl. 

There are several data structures for preprocessing T for LCA queries that use linear space and 
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T 

Figure 3: The trees T and Tx and their interval labeUing. 

answer queries in 0(1) time. Thus all that remains is to give a data structure for computing x{u) for any 
value X and any node u of T. Consider the minimal subtree of T that is connected and contains the root 
of T as well as all nodes whose label is x. Furthermore, contract all degree 2 vertices in this subtree with 
the exception of the root and call the resulting tree (see Fig. |3jl . It is clear that the tree has size 
proportional to the number of nodes labelled x in the original tree. Furthermore, by preprocessing 
with an LCA data structure and labelling the nodes of with their distance to root, we can compute, 
for any nodes u and v in T^, the number of nodes labelled x on the path from u to u in T. 

The difficulty now is that we can only do range counting queries between nodes u and v that 
occur in and we need to answer these queries for any u and v in T. What we require is a mapping of 
the nodes of T onto corresponding nodes in T^. More precisely, for each node w in T we need to be able 
to identify the first node labelled encountered on the path from v to the root of T. Furthermore, we 
must be able to do this with a data structure whose size is related to the size of T^, not T. 

To achieve this mapping, we perform an interval labelling of the nodes in T (see Fig.lSjl : We label 
the nodes of T with consecutive integers by an in-order traversal of T. With each internal node v of T, 
we assign the minimum interval that contains all of the integer labels in the subtree rooted at v. Note 
that every node in is also a node in T, so this also gives an interval labelling of the corresponding 
nodes in (although the intervals are not minimal). Consider a node v oiT whose integer label is g. 
Then it is easy to verify that the first node labelled x on the path from v to the root of T is the node of 
Tx with the smallest interval label that contains g. Next, observe that if we sort the endpoints of these 
intervals then in any subinterval defined by two consecutive endpoints the answer to a query is the same. 
Therefore, by sorting the endpoints of the intervals of nodes in and storing these in a sorted array we 
can answer these queries in O(logn) time using a data structure of size OdTj^j). 

To summarize, we have described all the data structures needed to answer range counting 
queries in O(logn) time using a data structure of size 0{n). To answer a range mode query {u,v) 
we first lookup the two subtrees T„ and Ty of T that contain u and v as well as a mode m„,„ of all the 
labels encountered on the path from T„ to Ty. We then perform range counting queries for each of the 
distinct labels in T„ and T„ as well as to„ ^, to determine an overall mode. The running time and storage 
requirements are identical to the data structure for lists. 

Theorem 3. For any < e < 1/2, there exists a data structure of size 0{n'^^^'^) that answers range mode 
queries on trees in 0{n'^ logn) time. 
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4 Range Median Queries on Lists 



In this section we consider the problem of answering range median queries on lists. To do this, we take 
the same general approach used to answer range mode queries. We perform a preprocessing of A so that 
our range median query reduces to the problem of computing the median of the union of several sets. 



4.1 The Median of Several Sorted Sets 

In this section we present three basic results that will be used in our range median data structures. 

An augmented binary search tree is a binary search tree in which each node contains a size 
field that indicates the number of nodes in the subtree rooted at that node. This allows, for example, 
determining the rank of the root in constant time (it is the size of the left subtree plus 1) and indexing an 
element by rank in O(logn) time. Suppose we have three sets A, B, and C, stored in three augmented 
binary search trees Ta, Tb and Tc, respectively, and we wish find the element of rank i in Au B U C. 
The following lemma says that we can do this very quickly. 

Lemma 2. Let Ta, Tb, and Tc be three augmented binary search trees on the sets A, B, and C, respectively. 
There exists an 0{hA + Hb + he) time algorithm to find the element with rank i in Au B U C, where Ha, 
h B and he are the heights of Ta, Tb and Tc, respectively. 

Another tool we will make use of is a method of finding the median in the union of many sorted 

arrays. 

Lemma 3. Let Ai,. . . ,Ak be sorted arrays whose total size is 0{n). There exists an 0{klogn) time algo- 
rithm to find the element with rank i in Ai U ■ ■ ■ (J Ak. 

Finally, we also make use of the following fact which plays a role analagous to that of Lemma^ 

Lemma 4. Let A, B, and C be three sets such that \A\ = \C\ = k and \B\ > 4fc. Then the median of 
AUBUC is either in A, in C or is an element of B whose rank in B is in the range [\B\/2 — 2k, \B\/2 + 2k]. 



4.2 A First Time-Space Tradeoff 

To obtain our first data structure for range median queries we proceed in a manner similar to that used 
for range mode queries. We partition our list A into b blocks Bi, . . . , i?„/f, each of size ii/b. We will 
create two types of data structures. For each block we will create a data structure that summarizes that 
block. For each pair of blocks we will create a data structure that summarizes all the elements between 
that pair of blocks. 

To process each block we make use oi persistent augmented binary search trees. These are search 
trees in which, every time an item is inserted or deleted, a new version of the tree is created. These trees 
are called persistent because they allow accesses to all previous versions of the tree. The simplest method 
of implementing persistent augmented binary search trees is hy path-copying Il5l[7ll51|9| lllll . This results 
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Figure 4: The median of a^, . . . , can be computed from two persistent search trees. 

in O(logn) new nodes being created each time an element is inserted or deleted, so a sequence of n 
update operations creates a set of n trees that are represented by a data structure of size 0{n log n).^ 

For each block Bi> = 6,v^i, . . . , bii^n/b> we create two persistent augmented search trees T^^' and 
^i'. To create T^^/ we insert the elements bi',i,bi'^2, ■ ■ ■ , h',n/b in that order. To create 'Ti> we insert the 
same elements in reverse order, i.e., we insert bi>^n/b, ^j',Ti/f)-i; ■ • ■ 7 Since these trees are persistent, 
this means that, for any j, 1 < j < n/b, we have access to a search tree T^i'.j that contains exactly the 
elements 6,;'^i, . . . , bi'j and a search tree 'Tiij that contains exactly the elements bi'j, . . . , bi'.n/b- 

For each pair of blocks Bi> and Bj>, I < i' < j' < n, we sort the elements of S^'+i U • • • U Bj'-i 
and store the elements whose ranks are within 2n/b of the median in a sorted array Ai'j'. Observe that, 
byLemmal^the answer to a range median query wherei — i'n/b + xis in block «' and j = j'n/b+y 
is in block j', is in one , Ai>^j> or j'.y (see Fig.Q. Furthermore, given these two trees and one 

array. Lemma 121 allows us to find the median in O(logn) time. 

Thus far, we have a data structure that allows us to answer any range median query (i, j) where 
i and j are in different blocks i' and j' . The size of the data structure for each block is 0{{n/b) log n) and 
the size of the data structure for each pair of blocks is 0{n/b). Therefore, the overall size of this data 
structure is 0(n(6 + logn)). To obtain a data structure that answers queries for any range median query 
(i, j) including i and j in the same block, we build data structures recursively for each block. The size of 
all these data structures is given by the recurrence 

T„ = feT„/b + 0(n(6 + logn)) -0((n(6 + logn))log,n . 

Theorem 4. For any 1 < b < n, there exists a data structure of size 0{n{b + logn)logf,n that answers 
range median queries on lists in time 0{\og{n/b)). 

At least asjmiptotically, the optimal choice of 6 is 6 = log n. In this case, we obtain an 0{n log^ n/ log log n) 
space data structure that answers queries in O(logn) time. In practice, the choice & = 2 is probably 
preferable since it avoids having to compute the Aiij> arrays altogether and only ever requires finding 
the median in two augmented binary search trees. The cost of this simplification is only an 0(loglog7i) 
factor in the space requirement. 

^Although there are persistent binary search trees that require only 0(n) space for n operations I?||10I . these trees are not 
augmented and thus do not work for our application. In particular, they do not allow us to make use of Lemmal21 
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Figure 5: Using range trees to perform range median queries. The median of 
the elements in the 0(6 log;, n) shaded arrays. 



is the median of 



4.3 A Constant Query Time Subquadratic Space Data Structure 



Next we sketch a range median query data structure with constant query time and subquadratic space. 
The data structure is essentially the same as the range mode query data structure described in Section lZ2l 
modified to perform median queries. The modifications are as follows: For each pair of blocks Bi> and 
Bj> we need only consider the set of 6k elements that are potential medians of queries with endpoints i 
and j in Bi> and Bj^ . We can also create a normalized version of these elements, so that each element is 
a unique integer in the range 1, . . . , 6k. In this way, we only need to create (6fc)! different lookup tables, 
each of size 0{k'^). 



To summarize, storing all the lookup tables takes 0(fc^(6fc)!) space. For each pair of blocks we 
must store a pointer to a lookup table as well as an array of size 6k that translates ranks in the lookup 
table to elements of A, for a total space of OilP'k). For each block we precompute and store all the 
solutions to queries with both endpoints in that block. Setting k — clogn/ log log rt for sufficiently small 
c, we obtain an overall space bound of 0(n^ log log n/ log^ n). 

Theorem 5. There exists a data structure of size 0(n^ loglogn/ log^ n) that can answer range median 
queries on lists in 0(1) time. 



4.4 A Data Structure Based on Range Trees 



Next we describe a range median data structure based on the same principle as Lueker and Willard's 
range trees [6, 15 1. This data structure stores ai, . . . , a„ at the leaves of a complete 6-ary tree T in the 
order in which they appear in A. At each internal node v of this tree we keep a sorted array containing 
all the elements of A that appear at leaves in the subtree rooted at v. It is clear that this tree, including 
the arrays stored at all the nodes, has size 0{n log;, n). 

To use this tree to answer a range query consider the two paths Pi and Pj from the root 
of T to the leaf containing and the leaf containing aj, respectively (see Fig.lSjl. These two paths share 
some nodes for a period of time and then diverge. Observe that, after this point, by looking at the sorted 
arrays at nodes to the right of Pi and to the left of Pj we obtain a partition of a^, aj into a set of 
sorted arrays. The number of these arrays is at most b log;, n and their total size is at most n. Therefore, 
by Lemmalsjwe can answer the range median query (i, j) in 0(6 log^ n/ log 6) time. 

Theorem 6. For any integer I < b < n, there exists a data structure of size 0(nlog;, n) size that answers 
range median queries on lists in 0(6 log^ n/log6) time. In particular, for any constant e > there exists a 
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data structure of size 0{n) that answers range median queries in 0{vf) time. 



5 Range Median Queries on Trees 



Next we consider how to answer range median queries on trees. As before, we may assume that T is 
a binary tree by converting nodes node with d > 2 children into complete binary trees. In these little 
trees we subdivide edges to ensure that the number of internal nodes in any root to leaf path is even and 
label these nodes alternately with —oo, +00 so as not affect the median on any path between two of the 
original nodes of T. 

Our method is simply the binary version of the basic method in Section l431 for lists. We first find 
a centroid edge (a, h) of T whose removal partitions T into two subtrees Ta and Tb each of size at most 
2/3 the original size of T. For each node u in Ta, we would like to have access to an augmented search 
tree that contains exactly the labels on the path from u to a. To achieve this, we proceed as follows: To 
initialize the algorithm we insert the label of a into a persistent augmented binary search tree, mark a 
and define this new tree to be the tree of a. While some marked node u of Tq has an unmarked child v, 
we insert the label of v into the tree of u, mark v, and define this new tree to be the tree of v. Note that 
because we are using persistent search trees, this leaves the tree of u unchanged. In this way, for any 
node u in Ta, the tree of u contains exactly the labels of nodes on the path from u to a. We repeat the 
same procedure for T^, and this creates a data structure of size O(nlogn). 

To answer a range median query (u, v) where u is in Ta and v is in T&, we only need to find the 
median of all labels stored in the tree of a and the tree of h. By Lemma 121 this can be done in Oilogn) 
time. To answer range median queries (u, v) where both u and v are in Ta (or Th) we recursively build 
data structures for range median queries in Ta and T^. The total size of all these data structures is 

Tn = Tan + r(i-Q)« + 0{n\ogn) = O(nlog^n) , 

where 1/3 < a < 2/3 and they can answer range median queries in 0{\ogn) time. 

Theorem 7. There exists a data structure of size 0{n log^ n) that can answer range median queries in trees 
in O(logn) time. 

It is tempting to try and shave a log log n factor off the storage requirement of Theorem [7| by 
using a log n-ary version of the above scheme as we did in Section R^l However, the reason this worked 
for lists is that, for any block, a query either extends to the left or right boundary of that block, so only 
two persistent search trees are needed. However, if we try to make a logn-ary partition of a tree we 
find that each subtree (block) can have ri(log n) vertices that share an edge with another subtree, which 
would require Vtilogn) persistent search trees per subtree. 



6 Summary and Conclusions 



We have given data structures for answering range mode and range median queries on lists and trees. 
To the best of our knowledge, we are the first to study these problems. These problems do not seem to 
admit the same techniques used to develop optimal data structures for range queries involving group or 
semigroup operators. 



10 



Essentially every result in this paper is an open problem. There are no lower bounds for these 
problems and it seems unlikely that any of our data structures are optimal. Thus, there is still a significant 
amount of work to be done on these problems, either by improving these results and/or showing non- 
trivial lower bounds for these data structures. 
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